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ABSTRACT 

Task complexity in terms of symbolic mediation (inner 
thought) as a determinant of differential test performance and the 
prediction of dissimilar functioning were examined. Preschool 
children with moderate to profound speech and/or language handicaps 
were tested using: (1) a sound-in-words subtest of the Test of 
Articulation (TA); (2} Action Pictures (AP); (3) a Symbolic Mediation 
Test (SMT); and (4) the Schenectady Kindergarten Rating Scale of 
classroom behavior. Controls were included tot test demands; the 
progression from low to high symbolic mediation tasks; the subject 
response mode; and examiner silence. Familiar and unfamiliar, 
examiners certified and experienced in early childhood education 
administered the tests in instruct and no-instruct groups. The 
results among tests and variables" are discussed in relation to 
examiners' backgrounds. Statistical tables illustrate the AP Tasks 
and the SMT which is included in the appendix. (CM) 
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Abstract * 
The present investigation explored both, a variety of possible 

. i. « 

determinants of children's differential tiast performance* with familiar 
, and unfamiliar examiners and the prediction • of this dissimilar function- 
^/J^ng* Methods included the testing of 79 speech and language handi-'. 

capped preschool children' within a repeated measures, cross-over design. 

Findings are discussed in terms of differences in the familiar and un- 

familiar examiners^ experiential "backgrounds. 

• \ • • • * 



, \ • 



The Importance of Situational Factors and Task Demands 7 
to Handicapped Children* s Test Performance 

/ 

^ Educational psychologists recently have become interested in tile 

• * " • \ \ 

I ■ * 

role that situational factors play in affecting performance in assess- 

ment (cf. Sattler, 1974). As a result, a growing number of psychologists 

\ \ . 

no longer view an assessment instrument T s' content validity as a sufficient 

pre-condition in deciding whether the test measures what" it claims to \ 

test* 

Of the various situational variables explored in the assessment 

0 ' . « " 

seating, effects of examiner familiarity have been subjected to scrutiny 
*Viost often. The decision to focus on this situational variable often 
has been based upon the long standing developmental notion that children 
derive much of * their comprehension about and feelings toward a setting 
from the significant adult in that situation (cf . Freud, 1921/1922; 
Piaget, 1965). , 

Rosenthal (1980) suggested th^t the influence of prior contact is 
related- to the task set for the child; that is, unfamiliar examiners 
strengthen children's performance on simpleu tasks and weaken their per- 
formance on more complex test items. On simple tasks, Rosenthal specu- 
lated that the examiner's strangeness engenders anxiety in the child, 
. *• 
\ 

which dontribut§s & to the child's motivation to do welJ . This same anxiety, 
however, is presumed to interfere -with a child's higher order thinking 
required by more complex tasks. 

The notion, that prior contact is negatively related to optimal 
performance on simple tasks is consonant with empirical evidence 
(Rosenkrantz &. Van de Reit, 1972; Stevenson, Keen, & Knights, 1963). 
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The importance of examiner 'familiarity* to performance on more challenging 

r 

tasks, however, is less clear ^than Rosenthal suggests. ' ! 

\ * \ ^ 

' As a group, studies involving comparatively complex test items have 

suggested that differential performance depends in part upon the defini- 

0 

tion o£ examiner familiarity employed. When the familiarity of the 
examiner has been experimentally induced, subjects have not performed 
differentially (Jacobson, Berger, Bergman, Millham, & Greeson, 1971; 
~ Marine, 192^9; Tyson, 1968)% However, when familiarity has been defined 
in terms of a long-term acquaintanceship, subjects have exhibited stronger \ 
functioning with the' familiar than with the unfamiliar examiner (Kinnie 
& Scernloff, 1971; Olswang & Carpenter, 1978; Stoneman Gibson, 1978). 

' A study by Fuchs, Garwick, Featherstone, and Fuchs (1980), employ- 

^ * v , 

ing a long-term acquaintanceship definition of ekaminer familiarity, is 

" - I 

the only investigation known to explore subjects 1 responses to familiar 

• ■ and unfamiliar examiners on both simple and complex tasks. Corroborating 

previous findings, Fuchs et al. discovered that test performance inter- 

acted with task complexity. On complex items, subjects 1 mean test per- 

'fonnance was dramatically greater in the familiar than in the unfamiliar 

condition;* there was no such differential functioning on^ simpler tasks. 

In addition to examining relationships between examiner familiarity , 

■ * * 

and children's performance on difficult and. relatively simple tasks, Fuchs , 
et al. asked teachers to complete an expanded version of the Schenectady 
Kindergarten Rating Scale- on the subjects (cf. Fuchs, et al., 1980). 
This scale generated descriptions on a wide-range of behaviors demonstrated 
'* Ijy subjects in their classrooms. The teachers' ratings were used to pre- 

dict differential performance in jthe assessment situation. Six classroom 
behaviors contributed significantly to the variance of the difference 
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between subjects' performance in familiar and unfamiliar conditions. 



Four of these behaviors were related both to subjects' capacity to use 
language in the classroom and to subjects' feelings about th^ir speech 
and/or language handicap. Cumulatively, the six behaviors explained 

36% of the variance; all 17 variables constituting the rating scale 

\> 

accounted for 45% of the variance. 

The, present study continued to explore determinants and prediction 
of children's differential test performance. 
Task Complexity and Mode of Response * 

The present* study explored task complexity, defined in terms of 
symbolic mediation, as a determinant -of differential test performance. 
The tasks were different from those, used by Fuchs et al. (1980), where 
items differed, in terms of the degree to which they directed pupils' .per- 
formance and the amounts of examiner'- examinee involvement, as well as 
in terms of symbolic mediation. By regulating the nature of the test 
materials and the format governing their presentation, the present study 

attempted to control for test demands, othdr tjian symbolic mediation, 

* « 

that might influence , test .performance. In addition, many more items were 
used to assess symbolic mediation so that the progression from low to high 
* sy ~. mediation tasks could be controlled more carefully. 

Also controlled systematically was the mode, or manner, in which 
subjects were required to respond to the experimental tasks. At each level 
of task complexity, certain items required verbal responses while other 
test items necessitated gestural responses. Selection of the verbal and 
gestural modes was influenced by the fact that the study samplede^^rat-ed 



moderate ^to profound speech or language^J^ndicapsT^ 

By sharpening' and^e5Ttmding previous conceptualizations of task 



""Tcfeinands, this study attempted (a) to clarify characteristics of difficult 



1/ 



tasks that help to explain differential test performance, and (b) to 
build upon the knowledge base that would permit one, ultimately, to 

* 

identify tasks that promote differential test performance. Such knowledge, 
in certain instances, may call for modifications of the testing ^procedure 



that enhance the validity of assessment results 



Prediction of Differential Test Performance 



\ 




X 



This study also extended efforts by Fuchs et al. (1930) to predict 

differential test performance on the basis of teachers' ratings of pupils 1 

classroom behavior. This -extension of earlier work w^s accomplished /by 

cross-validating the behavior rating scale employed by Fuchs et al. on , 

a population that was larger than, but similar to, subjects in the former 

study. This^ effort was undertaken because of the need to predict which 

pupils may require special attention from the examiner before assessment 

to promote optimal performance. The iu^ortance of such a procedure was 

suggested by two findings of Fuchs et al.: (a) clinicians who worked 

regularly with the subjects predicted dramatically fewer students to 

perform differentially than the number of pupils who actually did so, 

«. — ~ -~ 
and (b) familiar and unfamiliar examiners appeared insensitive^p^diff eren- 

** * * 
tial performers as revealed by their responses^o-a posttest questionnaire. 



If students who perform deferentially in assessment, represent a small 
proportion of a classroom population, and these pupils can be identified 
prior to assessment, it may be possible for the classroom teachers of 
these students, rather than clinicians, to function as examiners for this' 
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special group of pupils* Appropriate training in test administration 
would be a necessary prerequisite Z8f such a strategy* 

Examiner Behavior and Differential Test Performance 

ft 

The vast majority of . previous investigations of dif f erential 'test 
performance imply that examinee characteristics, alone (Seitz, 1980), 
or in combination with task characteristics (cf. Sattler, -1974), determine 
similar or dissimilar performance with familiar and unfamiliar adults. 
The importance of examiner behaviors rarely < SiaiT"been studied. Neverthe- 
less, their salience is suggested by Rosenthal's (1980) work, a large 
corpus of investigations that demonstrates the profound impact others 1 



expectations may exert on subjects' performance, Rosenthal (1973) cited 
four ways in which expectations may be communicated. Teachers who expect 
good things from their students (a) create a^ warmer social-eraotibnal mood 
around their "special" students, (b) give more feedback to these students 
about their performance, (c) teach more material to them, and (d) give ^ 
their-^special" students more opportunity to respond. 



Fuchs et al. (1980) obtained results in' support of the last of these 
phenomena and, by so doing, indirectly corroborated the importance of 



examiners 1 expectations to examinees 1 test performance. % Fuchs et al. 



found a significant and dramatic association between both the amount and 

/ 

variation o.f silence exhibited by familiar and unfamiliar examiners-andf" 



handicapped pupils 1 differential test performance. Familiar examiners 
allowed very long silences with some children and granted scant silence 
to other pupils; unfamiliar examiners uniformly permitted brief periods of 
silence. Further analyses are required to ff iocate ff more precisely \these 
instances-of silence in the communicative flow between examiners and 
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examinees. before one may posit confidently any possible effect^ they may . 
exercise on pupils', test performance. However," at this point, it seems . 
that familiar examiners permit subjects adequate opportunity to respond 
while- unfamiliar examiners, by prematurely terminating theutest session, 
frequently do .not offer the same chance. 

Moreovf^, one may speculate that the unfamiliar examiner s' * proneness v - — 
to terminate the testing in an untimely manner was related to their ig- 
norance and comparatively low estimates of subjects' skilJL level and knowl- 
edge basey^onfronted* ^y 'subjects' discomfort in response to some test 
requirement, unfamiliar examiners had to decide whether to ignore* this un- 

ease and encourage continued effort or to withdraw the v test demand and 

/ - ' 

assuage manifest .anxiety. Presumably, this decision normally requires 

r 

grounding in what the examiner understands about an examinee's capabili-i 
ties. Because unfamiliar examiners in this 'study had limited information 
about subjects' ability levels, were presumably perceptive about and em- 
pattii^c toward^children's feelings, and were no doubt aware of their need 
for subjects' cooperativeness, they may have experienced no alternative 
but to behave conservatively and employ subjects' discomfort as a primary 
cue in determining when to conclude testing. ' 

In contradistinction, 1 familiar examiners, by definition, had a more - 
accurate notion of which subjects were capable and incapable of perf^jp^ 
ing. When faced by subjects who were reticent and uncomfortable, yet ^ 
known to be capable, familiar examiners appeared comparatively unresponsive 
to their silence and insensitive to their display of discomfort, sup- 
positively as a means of communicating an expectation that subjects function 
in accordance with their potential. Furthermore, because their 



relationship to the subjects rested upon a -relatively long prior acquajn- 
tanceship, it is suggested the familiar examiners were less concerned 
than unfamiliar examiners about subjects', discontinued cooperation during 

assessment* < * t 

• « ^* 

No' additional research in the general assessment literature is* knowtl 
that pertains to these findings and speculations*- However, investigations 
in the area of ^lassroom teaching and" counseling demonstrate the power- 
ful 'effects tliat silence may exercis\ on human beha\£ior* -Rowe (1£74), 
for. example, systematically varied^ the \amount> of silence permitted by 
teachers following both teacher questioning and pupils* .responses. She 
discovered that by increasing the amount of permissable time to respond, 

length jand quality of students 1 utterances and the frequency of pifpil- 
initiat€<r speech increased. « 

Similarly, in counseling research individuals consistently reported 
a preference for theiiplsts who spoke less frequently (Kleinke *&-Tully , < 

. c \ >>• f \ \ • . . 

1979) • Jhis remained the case even when the content of therapists r talk 
was controlled. Moreover, several sources suggest that clients perform 
better in therapy when there is an opportunity for silence (e.g.,' Rogers, 
•1951). 

t > * * # * 

Tp gauge the effects of examiners 1 behavior on examinees 1 differential 

*\ * 
test performance, familiar and unfamiliar examiners 1 use of silence was . 

manipulated experimentally in the present stud£. It was anticipated*, that. 

subjects 1 - presume^ differential test performance would be less strong when 

familiar and unfamiliar examiners were^required to extend equa? amounts 




of response' time tl^r when the amount of response time^was left to the 
discretion of \rt:he' examiners. 



\ 
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The importance of this endeavor was predicated upon the* fact that 
differentiaX^test perfomatroe^wiT:h^fam±li^aTr and -utrf amtli-ar Bxardners- 1 - 
represents a source of error variance in the way tests currently are 
' administered. If this differential performance may be attentuated by 
modifying select procedures in the test setting (e.g., retiring unfamiliar 



Y 

ances may result. The importance of this line of inquiry is underscored 



examiners to offer examinees adequate response time) , more v^iid perform- 



by the fact that virtually all test manuals presently used by clinicians 

are insensitive to the possible negative effects of unfamiliar examiners 

* • * 

'on children's test performance. 

In summary, the purpose of the present investigation was to examine 

the effects of three variables (levels ^of symbolic mediation, response 

mode, and examiner silence) on children's differential test performance 

and tljie. prediction of this dissimilar functioning .*ith familiar and unfamiliar 

examiners. Efforts, to predict differential test performance consisted of 

cross- validating a prediction instrument used in a previous study by Tuchs 

et al. (1980). 

M ethod 

Subjects ' * 

Subjects were 7S preschool children whose speech and/or language 
functioning constituted a moderate to profound handicap • They were 
enrolled in one x of, three special education programs located in Minneapolis 
or St. Paul, Minnesota. Sixteen* subjects attended Prpgram A, 28 subjects 
came from Program B, and 35 pupils were enrolled in. Program C. Children 
who were mentally retarded as well as speech or language impaired were 
excluded from the^study. When -data were available, mental vj^taxdation 

* • . o 

* ' * - , lo , 



was defined in accordance with AAMD Guidelines (cf. Grossman, 1973). 

In several cases IQ data were not available and exclusion from the study 



J was based upon teachers' evaluations of general classroom functioning* 

/ 

-Also eliminated from the investigation were subjects who had been in their 
classrooms less than 6 weeks prior to the date on which the study began. 
Measures 

Test of Articulation (TA) . The Sound-in-Words subtest of the TA j . 
(Goldman & Fristoe, 1972) was administered to replicate Tuchs et al. * 
(1980). This subtest consists of 35 illustrations depicting objects 
and activities that are familiar to young children. Examiners were in- 
, structed ,to elicit both a spontaneous and imitative response from the 



subjects. To facilitate a spontaneous response, examiners presented all 
of the pictures and for each one inquired, "What is this?" Regardless 
of whether the subject responded correctly, incorrectly, or failed to 
provide any answer, the examiner then instructed the subject to Say 



modeling the correct name for the depicted object. This second direction 
yielded an imitative respdtse. Neither the subjects' imitative nor spon- 

4 

taneous performance was scored since previous findings (Fuchs et al., 1980) 
failed to indicate differential responses to familiar and unfamiliar ex- 
aminers on this measure. Also, in an effort to limit the duration of the 
total testing -session, only the first two-thirds of the Sounds- in-Words 
subtest was administered. > 1 

Action Pictures (AP j . Two black and white pictures, one 14.0 cm x 
10.8 cm and the othe? 15.0 cm x 13.3 cm, were selected first for their 
unambiguous depiction of actors, emotions, activities, props, arid settings 
and, second, for the interest they promised to hold for the study sample. 

# . 

is 
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They were administered in two different experimental conditions that 

are described below. Subjects' verbal descriptions of the AP were 

recorded on audio tape during testing and scored later by a certified 
» 

speech clinician who was unaware of the experimental questions and 
who knew neither the subjects nor the examiners. Subjects' responses 
were evaluated in terms cf the total number of intelligible words and 
syllables employed to describe the illustrations. 
f Symbolic Mediation Test (SMT) . Developed for the present study, this 
measure consists of 18 items that are organized along two dimensions, com- 
plexity of symbolic mediation and mode of response. Subjects capacity 

4 

t o empl oy symbolic mediation (SM), or inn er- thought, was assessed by 
six items at each .of three increasingly complex levels, low (LSMh mid 
(MSM), and high (HSM) . At each of tft£^ levels, three items required a 
verbal response (VR) and three required a gestural response, (GR) . 

LSM/GR tasks *asked subjects to select from an array an object that 
matches a standard. LSM/VR test items required subjects to provide a 
one-word label for an illustration of a commonplace object. MSM tasgs * 
assessed subjects' ability to perform in-class matching. For example, > 
one* MSM/GR item presents one page with pictures of a taxi and airplane 
and another with a stop sign, boat, cup, and lightening. The subject is 
instracted to point to the object on this second page (i.e., boat) that 
- shares an essential functional similarity *with the objects shown on the 
first page (i.e., types of travel). One of three MSM/VR tasks presents 
the subject with illustrations of, a wolf, pig, and zebra; the subject 
is informed that the pictures are al|. of animals. Next, a picture is 
presented that displays a hamburger, sliced loaf. of bread, and sandwich; 

• -l - 
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pointing to each in turn, the examiner inquires, "This, this and this 

are all ?" HSM tasks evaluated subjects 1 capacity to analyze 

and integrate segments of visual information, of relatively high symbolic 

value, in order to tell a story. HSM/ GR items required \a) an arrangement 

of cut-up representational drawings so that they relate a meaningful tern- 

poral sequence, and (b) an identification of a geometric form that correctly 

'completes an 'abstract pattern. Tv<5 HSM/VR tasks each call on subjects to 

tell a story about three interrelated illustrations. The third test item 

presents only two related pictures and requires the subject to extrapolate 

to finish the story. 
* 

Examiners 'scored subjects' performance on the LSM, MSM, and HSM/GR 
tasks*. Subjects 1 responses to the HSM/VR items were recorded on audio 
tape, transcribed by a certified speech clinician who was unaware of the 
experimental questions, and evaluated by three of the investigators who 
worked .as a group to score each response. Subjects 1 -responses to familiar 
and unfamiliar examiners were evaluated on the basis o£ seven scores: 
LSM/GR, LSM/VR, MSM/GR, MSM/VR, HSM/GR, HSM/VR, and Total Score. For the 
first six of these 0 to 3 points were awarded; 1 point was given for each 
correct response. The maximum 5 number of points awarded for the total score 
was 18 points. &p 

Schenectady Kindergarten Rating Scale . Constructed by Conrad and 
Tobiessen (1967) , thd^s instrument examines pupils 1 classroom behavior. 

In its expanded form (cf. Fuchs ct al., 1980), it is comprised of 17 

O- 

items that are rated along a 3 to 7 point scale. This expanded version 
was completed by classroom teachers on each of the subjects following the 
conclusion of all testing* 



IG 
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Procedure - * 

Examiners , There was a total of 17 examiners. Eleven of these, 
as classroom teachers of the subjects, were familiar examiners; six 
examiners were unfamiliar to the subjects. All testers were female, 
certified in early childhood education, and had at least several years 
of experience working with preschool children in educational settings. 
Familiar and unfamiliar examiners were trained separately in the adminis- 
tration of the experimental tasks by three certified speech clinicians 
who were unaware of the study 1 s purposes. 

Design . At" each study site, subjects were randomly assigned to 
Group 1 or Group 2. The two groups differed only in terms of the presen- 
tation of ;^the^APHUsk--tsee No Instruct and Instruct conditions descri bed 
below); the TA and SWT tasks were identical for the two groups. (The TA . 
.task for both groups, and the AP task for Group 1 replicated those used by 
Puchs et al., 1980.) The three tasks were presented to all subjects in 
the same order: TA fi.st, then AP A and SMTlast. Within each grou0, 
subjects initially were assigned randomly to either the Familiar Examiner 
(teacher) or Unfamiliar Examiner (stronger) condition. All subjects 
were assessed twice, within a crossover design, so that all were tested 
bj both tyjpes of examiners. The Schenectady^ Kindergarten Rating Scale 
was cQmpleted by classroom teachers for Group 1 subjects since they con- 
stituted the cross-validation population. 

No Instruct condition . The AP task was presented to Group 1 subjects 
following the procedures of Fuchs et al. (1980). Action pictures were 
presented by examiners who began with, "Tell me about this picture. 11 If 
the subject refused to respond, the examiner provided additional 
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encouragement by stating, "Tell me what's happening?" If the child - 
remained silent, the task was discontinued. If, on the other hand, the 
subject provided information about the picture after the initial instruc- 
tion, the examiner gave adequate time. for the child to complete the 
response, and then saiH, "Can you tell me more?" After the subject was 
permitted an opportunity to do so, the task was terminated. ^ 

Although the examiners were required to administer the experimental 
tasks according to the aforementioned instructions, guidelines we^e pur- s 
posefully withheld concerning aspects of the assessment situation infre- 
quently controlled by the examiner manuals of published tests. Examiners 

$ 

were instructed to exercise , their own judgment concerning such factors 
as_ the frequency and qualitative nature of feedback to be given, the use 

~ ~ ~ — - « • 



of open-ended questions in the test setting prior to the* test proper, 

\ 

and the amount of response* time permitted. 

Instruct condition . The AP task was presented to Group 2 subjects 
using the same verbal instructions as examiners used with Group 1. subjects. 
However, examiners for this group were not. directed to use their , discretion 
in determining response time; rather, they were required to follow a pro- 
cedure that allotted a constant amount of response time. This was accom- 
plished by controlling both when examiners used silence and how much 
silence examiners employed. Figure 1 diagrams the experimental procedure 
t/hat governed communication in the Instruct Condition. 



Insert Figure 1 about here 



Analyses 



Number of words and syllables used to describe the action pictures 
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was analysed separately in both (a), one within factor (Familiar - Un- 
familiar Examiner) and one between factor (Instruct - No Instruct) 
analysis of variance and (b) one within factor (Familiar - Unfamiliar 
^xaminer) and two between factor (Instruct - No Instruct and Site) 
analysis of variance.*! Raw score performance on the'SMT was analyzed 
in three within (Familiar - Unfamiliar Examiner and Task Complexity 
and Mode of Response) and one between (Site) analysis of variance* 
A\j.so, total raw score performance on the SMT wai^ analyzed in one 

within (Familiar - Unfamiliar Examiner) analysis of variance. The' 17 

\ 

behavioral categories constituting the modified Schenectady Kindergarten 
Rating Scale were entered in a forward step-wise multiple regression to 
predict, differences between performance in Familiar and Unfamiliar testing 
conditions. 

> 

Results • w , 

Examiner Behavior (No Instruct vs ^Instruct) 

Subjects 1 syllabic production on the AP task with familiar and unfam- 
iliar examiners in the No Instruct and Instruct conditions is displayed * 
in Table 1. Subjects' syllabic productions were significantly greater 
in the Instruct than No Instruct condition. This remained the case with 
the site factor, F(l,73) -'9.2P, £- .003, and without the site factor, 
F(l,77) * 10.01, £ * .002, included. No significant interactions were 
found between the ^Familiar /Unfamiliar Examiner and Instruct/No Instruct^ 
conditions. - ? 

Insert Table 1 about here 



Comparable results were obtained wheA the dependent variable was 



ERLC 



words^spoken (see Table 2) . Subjects in both the Familiar and Unfamiliar 
Examiner conditions employed a significantly greater number of words in 
the Instruct than in the No Instruct condition. This remained true both 
when program site was excluded, F(l,77) » 10.20, £ " -002, and included, 
F(l,73) 10.46, £ 515 '002, as a blocking factor. As is evident in the 
table, subjects' raw score performance in the No Instruct conditio^ gener- 
ally was higher when tested by iamiliar than by unfamiliar examiners.^ The 
only exception to this was subjects' performance at site A, where* an 
equal mean number of words was produced with the two types of examiners. 
Again, the interaction between Examiner conditions and Instruct/No Instruct 



conditions was noV significant. 

\ * ^ ... ^ f ^ 

Insert Table 2 about Tiere 



Examiner Familiarity \ 

\ 1 

Subjects* performance on the SMT, analyzed as a sum of their responses 

/ • \ 

to the*18-item measure, revealed a main effect for the examiner condition, 

V - 

F(l,76) * 4*0jP, £ =» .047 (see Table 3). Totaled across levels of task com- 
plexity and modes of response, subjects 1 performance was greater inthe 
Familiar (X » 2.24) than in the Unfamiliar (X 2.-19) condition. 



Insert Table 3 about here \ \ 



Task Complexity 

Table 4 portrays differences between performance in Familiar and Un- 
familiar conditions by task complexity, mode of response, and study site. 
A statistically significant" main effect was obtained for tasl\complexity, 
F(2,152) * 263.46, £ <^000. -Subjects' performance was strongest"^ the 
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first (simplest) level of the SMT (X - 2.95) and weakest on 'the third 
(most challenging) level (X = 1.38) of this measure (middle level X = 
2.31). A contrast of the third vs th^firstjinji^^ 
nificant, t_(l,l3l)_-3UOT937'gprT01, as was a comparison of th<S first 
and second levels, £(1,152) » A. 83, £ < .01. Despite the findings of ■ 
significant main effects for Examiner Familiarity and Task Complexity, 
and the significant decrement-in performance on the SMT at each succes- 
sively higher-order level, there was no significant interaction between 
Examiner Familiarity and Task Complexity. 



Insert Table A about here 



Mode of Response 

A. significant main effect was found for mode of response, £(1,76) ■ 
33. 9A, £ <.000. Marginal means for tasks demanding gestural and verbal 
responses were 2.39 and 2.04, respectively. Also, a significant inter- 
action was found between mode of response and task difficulty, F(2,152) 
- 13.96, £ < .000. Performance on gestural response tasks minus verbal 
response tasks for the first, second, and third levels of task complexity 
were .006, .715, andl .304, respectively. A comparison of these differ- 
ences be^W^en first level and second* and third levels. of task difficulty 
yielded eignih^t results/ Jt( 1,152) - A. 78, £ < .01. Also significant 
was a contrast of gfe^tural minus verbal differences between the first 
and second levels, £(1,15^) * 3.38, £ < .01. 

Prediction of Differential Performance with Familiar and 
Unfamiliar Examiners \ \~ 

None of the categories constituting the modified Schenectady Kinder- 

\ 

garten Rating Scale contributed Significantly to the explained variance in 



Jthejiiff^^^ perfotnvac* «;h* A? in Fami'iar and Unfamiliar 

testing conditions, the dependent variable* There was, however, c lack 
of differentiated performance on this dependent variable as a function of 
examiner familiarity* 

/ • ■ 

Discussion * 

In contrast to findings from a previous study by Fuchs et al. (1980), 
subjects did not perform differentially when tested by familiar aud un- 
familiar examiners on the AP task*^ Possible explanations for the discrep- 



ant results include variations between the two studies in experimental 
procedures and in subject or examiner .charac* eristics* However, because 



the experimental procedures were relatively straightforward and care was 
taken in the second investigation to replicate the manner in which the AP 

Si 

task was administered, it is unlikely that changes in the experimental 
procedures explain the different results* 

At first glance, variation between the studies in subject and examiner 
characteristics also appears to be an improbable explanatory, factor ♦ Sub- " 



jects in the previous and present investigations were all^ speech and 
language. handicapped pupils who attended special education preschool . 
programs* Also, in both studies examiners were matched for several pre- 
sumably important professional and personal characteristics* All were 
female Caucasians, certified in early childhood education, and all had at 
least several years of experience with preschool children in educational 
settings* \ / 

Howaver, an aspect of the examiners 1 .experiential background over o 
which no control was exercised was the extent of their previous contact 
with handicapped pupils* In the first study, none of the four unfamiliar 
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examiners had previous experience with handicapped children; in this 
study more than half (four.. out of six) of the unfamiliar examiners were 

x 

currently or had been employed previously as teachers of handicapped 
preschoolers. Thus, the absence of differential functioning, on the 
AP task in the second study may have been associated with the deployment 
of examiners who were unfamiliar to the exaiiinees in a personal sense, 
but, for the most part, had* professional familiarity with Uie type of 
child constituting the study sample. This raises the hypothesis that the 

o 

examiner \s specialize^ professional training and experience may vitiate 
the adverse effects of Tff3/If^irpersonal^unf with an examinee's 

performance. 

DeStafano, Gesten, and Cowen (1977) produced evidence supportive of 
this speculation. Examining mental health professionals 1 and regular class 
room teachers 1 attitudes about and expectations for handicapped children, 
DeStafano et al. discovered that the mental- health professionals were more 
positive about handicapped pupils and held more optimistic prognoses for 
them. Similarly, special education teachers, in comparison to regular 
classrobm__teachers, may view handicapped children more positively and 
hold higher expectations for them in the assessment setting. And, in 
turn, this may encourage handicapped students to perform optimally in 
this situation, irrespective of thejLr personal familiarity with the indi- 
vidual special educator. (cf. Rosenthal, 1980). Whether an examiner's 
professional training and experience vitiates the adverse effects of 
his/her personal unf amiliarity with an examinee is an important question 
because the adult who tests handicapped children £iTschSt>ls and clinics, 
while often a stranger to the child, usually .has at least some familiarity 
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« * 

with handicapped students* * 

* While subjects performed similarly with familiar and unfamiliar 
examiners on the AP task, their performance on the SMT was significantly % . 
stronger in the familiar condition* Subjects' differential performance 
on the" SMT appears to # contradict the argument that examiners' professional 
familiarity with handicapped-children may substitute for a lack of per- 
sonal familiarity as a means of optimizing performance in assessment . 
The marginal level of significance <£ * .047) of subjects' differential 
functioning on the SMT should be noted, however* * 

While" there was no main effect for the examiner condition on the AP 
task and .only a marginally significant main effect for the examiner condi- 
tion on the SMT, as anticipated, there were strong main effects for the * 
— — ~ - _ ' 

Insthruct/No Instruct condition, Task Complexity, and Mode ^of Response* 

By demonstrating a positive, direct relationship between amount of 
response time and extent of subjects' responses on the AP task, this 
investigation corroborated previous findings that indicated the importance 

i « » 

'of teachers' (Rowe, 197',) and therapists' (Kleinke & Tully, 1979) silence 
to students' and clients' performance, respectively. Because of its 
demonstrated powerful effect upon performance, and because it is used 
arbitrarily in assessment settings, examiner silence should be regarded 
as an important situational factor in test situations* Whetfier it repre- 
sents a source of error variance in particular circumstances should be 
a focus of future research* 

Main effects fpr task complexity and mode of response represent support 
for the construct validity of the SMT instrument developed for the present 
study. There is an additional possible implication for the obtained main 
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effect for mode of response. Subjects 1 weaker performance on tasks 
requiring verbal responses suggest that the many screening,, diagnostic, 
achievement, and intelligence tests requiring numerous responses in 
the verbal mode may seriously underestimate optimal functioning among 
select groups of' pupils, particularly children, with speech and language 
handicaps. This suggestion^of course, partly depends upon the pre- 
sumption that the test items requiring verbal and gestural responses at 
each level of co^lexity on the, SMT share similar cognitive demands. 

Finally,* because of absent or marginal effects for the examiner 
condition, no interaction effects were obtained for Task Complexity, 
Mode of Resptfhse, or Instruct/No Instruct conditions, and the Examiner 
condition. Future research should investigate the importance of these 
conditions within an experimental paradigm thai matches familiar and 
urifamiliar examiners more closely than was' done in the present study. 
? Assuming that such a paradigm will yield differential performance in 
favor of the familiar examiner, it will also facilitate a more reasonable 
test of our capacity to predict differential test performance on the 
basis of classroom behavior than was permitted by the present investigati 
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/ Table 1 

Syllabic Production on the Action Pictures (AP) Task 



No Instruct 



b 



Instruction ' ' Examiner Condition 

Condition Familiar , ! Unfamiliar 



Site A 11.14 (9.77) 20.29 (26.70) 

Site B 13.65(7.44) 11.30(7.62) 

Site C 17.06 (8.66) 14.88 (9.79)' 

Average 14.57 (8.40) 14.11 (13.07) 

Instruct 0 * • 

Site A 20.56 (19.94) 18.22 (14.81) 

'siteB, 25.40 (23.59) 23.13 (29.17) 

-SiteiC 38.00 (31.10) 56.00 (68.13) 

Average " 28.11 (25.64) 32.20 (45.15) { 

Entries are the means and standard deviations (in parentheses) 

the numbers of syllables produced. f 

b N - 4V(Site A* N « 7; Site B: N « 20; Site C: N « 17). 

C N - 35-(t*te As N - 9, Site B: N * 15; Site C: N 58 11). 



\ 



Table 2 



-Wpxd Production on the Actidn Picture (AP) Task 2 



25 



Instructign 1 
Condition \ 



No Instruct 



Instruct 



Site A 
Site B 
Site C 
Average 



Examiner Condition 



Familiar 



Unfamiliar 





Site A \ 

. 


J. 00 


(7.29) 


7.00 


(7.21) 


/ 


. Site B 

1 


10.40 


(6:39) 


. 8.25 


(6.03) 




Site^C- 


13.59 


(7.37) 


11.24 


(8.61)/ 




Average 1 


11.09 


(7.22) 


9.21 


(7.33) 




14.56 (16.74) 

19.40 (20.27) 

28.91 (25.76) 

21.14 (21.51) 



13.67 (12.56) 

/ 

18.67 (25.21) 
W.82 (47.24) 
24^34 (32.98) 



Entries are th< 
the numbers of 

^Numbers of subj 
Table 1. 



means and standard deviations (in parentheses) of 
words produced. 

ects\ in each condition and site are the same as in 
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Table 3 

tfotal Scores on Symbolic -Mediation Test (SMrf 



Site b 


Examiner 


Condition 


• 


- Familiar \ , 


Unr ami liar 




Site A 


12.56 (2.06) 


11.81 (3.25) 




Site B 


13.11 (2..-35) 


12.86 (2.18)- 


• 


Site C 


14.32 (1.77). 


14.03 (2.19) 





Entries are means -and standard deviations (in parentheses) of subjects 1 
SMT scores.^ , 

\ - 79 (Site A: N » 16; Site B: N * 35; Site C: N * 28) 

\ 
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t Table 4 

r ' . ' 

Number Correct on Groups of Items of the Symbolic Mediation Test' 



Task Complexity/. 
Mode of Response 


Site 
Familiar 


Unfamlixar 


Site B C 
Familiar Unfamiliar 


Site C d 
Familiar Unfamiliar 


Uligh 


• 












\ 




Verbal 


. 1.00 (0.89) 


1.13 


(0.96) 


1.14 


(0.88) 


1.09 (0.82) 


1.54 (0.79) 


1.39 (0.79) 


Gestural 


1.06 (1.12) 


1.06 


(0.93) 


1.31 


(1.08)* 


1.34 (1.16) 


2.00 (0.90) 


2.11 (0.92) 

* < 


Middle f 






I ■ 




« 




\ 




Verbal 


2.00 (0.63) 


1.88 


(0.89) 


2.00 


(0.91) 


1.89 (0.87) 


1.93 (0.66) 


•2.04 (0.84) 


Gestural 


2.56 (0.63) 


243 


(1.03) 


2.69 


(0.76) 


2.74 (0.61) 


2.86 (0.36) 


2.75 (0.44) 


Low 


















Verbal 


3.00 (0.00) 


2.88 


(0.34) 


2.97. 


(0.17) 


2.94 (0.24) 


-3.00 (0.00) 


2.89, (0..42) 


Gestural 


2.94 (0.25) 


2.75 


(0.58) 


3.00. 


(0.00) 


2.97 (0.17) 


3.00 (6.00) 


2.96 (0.19) 



I 

a Entries are means and standard deviations (in parentheses) of subjects' scores on groups of SMT items. 
b N = 16 

C N - 35 : « 
^ « 28 ' ' 
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Copies of the Symbolic Mediation Test are available from 
the Institute For Research on Learning Disabilities! 
University jof Minnesota {Research Report //SM>* 
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APPENDIX 

\ 

Symbolic Mediation Test* 



*The sequence cards used within this test are from Developmental ' 
Learning Materials, Niles, Illinois* f 
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